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(54) MULTIMEDIA DISPLAY DEVICE 

(57)Abstract: 

PROBLEM TO BE SOLVED: To provide a multimedia <t f 
display device which can display a corresponding 
position in a still picture and a document in 
synchronism with the contents of a reproduced 
animation. 

SOLUTION: This multimedia display device which 
displays an animation and a still picture 
synchronously is provided with a reproduction part 
104 which reproduces the animation, a still picture 
display part 103 which displays the still picture, a 
cursor display part 102 which displays a cursor 
indicating a position in the still picture, a reproducti 
position detection part 105 which detects the 
reproduction position of the animation, a position 
information storage part 101 which stores position information representing the display 
position and display section of the cursor in the still picture, and a control part 106 which 
controls the cursor display part so that the cursor is displayed at the display position is the 
still picture shown by the position information when the reproduction position of the 
animation found by the reproduction position detection part is in the display section of the 
position information. When the document and still picture are reproduced in synchronism 
with the moving picture, a specific position in the document and still picture which relates 
closely to the moving picture is indicated in synchronism with the reproduction of the 
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* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

LThis document has been translated by computer. So the translation may not reflect the 
original precisely. 

2.**** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



CLAIMS 

[Claim(s)] 

[Claim 1]A multimedia display which synchronizes and displays an animation, or a sound 
and a still picture, comprising: 

A regenerating section which reproduces an animation or a sound. 
A still picture indicator which displays a still picture. 

A graphic-display part which displays a tab-control-specification figure in which a position 
on a still picture is shown. 

A playback position primary detecting element which detects a playback position of an 
animation or a sound by a frame number or time information. 

A position information storage which stores position information showing the display section 
of said tab-control-specification figure shown by a display position, said frame number, or 
time information on a still picture of said tab-control-specification figure. 
A control section which controls said graphic-display part to display said tab-control- 
specification figure on a display position on a still picture which said position information 
expresses when a playback position of an animation for which said playback position 
primary detecting element was asked, or a sound hits at the display section of said position 
information. 

[Claim 2]A multimedia display which synchronizes and displays an animation and a 
document, comprising: 

A regenerating section which reproduces an animation. 

A text display area which displays each page of document data which comprises two or 
more pages. 

A scenario storage parts store which stores a scenario which specified an order of two or 
more scenes by making into a scene what matched a reproducing section of an animation, 
and a page of document data. 

A graphic-display part which displays a tab-control-specification figure in which a position 
on a page is shown. 
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A playback position primary detecting element which detects a playback position of an 
animation by a frame number or time information. 

A position information storage which stores position information showing the display section 
of said tab-control-specification figure shown by a display position, said frame number, or 
time information on a page of said tab-control-specification figure. 

According to a playback position of an animation which read a scenario from said scenario 
storage parts store and for which said playback position primary detecting element was 
asked, A control section which controls said graphic-display part to display said tab-control- 
specification figure on a display position on a page which said position information 
expresses when a page specified in said scenario is displayed on said text display area and 
said playback position hits it at the display section of said position information. 

[Claim 3]A display position of said tab-control-specification figure is set up on a page 
displayed with reproduction of an animation, The multimedia display according to claim 2, 
wherein said display position and the display section which possessed a position 
information set part which sets up the display section of said tab-control-specification figure 
from a playback position of said animation, and were set up by said position information set 
part are stored in said position information storage as said position information. 
[Claim 4]A multimedia display which synchronizes and displays an animation and a 
document, comprising: 

A regenerating section which reproduces an animation. 

A text display area which displays each page of document data which comprises two or 
more pages. 

A graphic-display part which displays a tab-control-specification figure in which a position 
on a page is shown. 

A playback position primary detecting element which detects a playback position of an 
animation by a frame number or time information. 

What matched a reproducing section of an animation and a page of document data is made 
into a scene, A scenario storage parts store which specifies an order of two or more scenes 
and stores a scenario which added position information showing the display section of said 
tab-control-specification figure shown by a display position, said frame number, or time 
information of said tab-control-specification figure on a page about each scene. 
According to a playback position of an animation which read a scenario from said scenario 
storage parts store and for which said playback position primary detecting element was 
asked, A control section which controls said graphic-display part to display said tab-control- 
specification figure on a display position on a page which said position information 
expresses when a page specified in said scenario is displayed on said text display area and 
said playback position hits it at the display section of position information on said scenario. 

[Claim 5]The multimedia display according to claim 4, wherein said scenario is described 
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using a tag and a tag which shows a video data in a tag showing each scene, a tag in 
which a page of document data is shown, and a tag in which position information on said 
tab-control-specification figure is shown are described hierarchical. 
[Claim 6]The multimedia display according to any one of claims 1 to 5, wherein said tab- 
control-specification figure is a pixel image of cursor, an icon, or a small region. 
[Claim 7]The multimedia display according to any one of claims 1 to 6, wherein said 
position information expresses a display position and the display section on an animation of 
said tab-control-specification figure and said graphic-display part displays said tab-control- 
specification figure on an animation. 

[Claim 8]The multimedia display according to any one of claims 2 to 5, wherein said 
document data comprises digital image data, PDF data, or word processor data which 
image-ized a text file, a structured document described by XML or SGML, and a document. 



[Translation done.] 
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* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the 
original precisely. 

2. **** shows the word which can not be translated. 
3.ln the drawings, any words are not translated. 



DETAILED DESCRIPTION 

[Detailed Description of the Invention] 
[0001] 

[Field of the lnvention]Modes, such as a lecture, a lecture, research presentation, are used 
and this invention enables it to reproduce and display multimedia for them intelligibly 
especially about the multimedia display which displays the multimedia contents in which an 
animation, a still picture, a text, a sound, etc. are contained. 
[0002] 

[Description of the Prior Art] Displaying an animation on a screen according to the scenario 
of multimedia contents, a multimedia display opens the window of a still picture or a text, 
and displays the still picture and text relevant to an animation. This scenario has specified 
the stage, the display position, and display information which open the window of a still 
picture or a text on the basis of the time-axis of an animation. If reproduction of an 
animation is started, a multimedia display will read the accumulation data of a still picture or 
a text specified by the appointed time according to specification of a scenario, and will 
indicate a still picture and the text by a designated time limit to the appointed field on a 
screen. 

[0003]An animation expresses a lecturer's operation, and if it edits so that the document to 
which this lecturer points may be displayed in the window of a text, the pattern of a lecture, 
a lecture, and research presentation will be expressed intelligibly for a televiewer as the 
contents in which a lecture, a lecture, research presentation, etc. were mentioned by 
reproduction of these contents. 
[0004] 

[Problem(s) to be Solved by the lnvention]However, when displaying multimedia contents, 
such as such a lecture, and a lecturer points to it and gives a lecture on the position on a 
document, If it is not clear where [ on the document in which the position was displayed on 
the window of the text ] it hits, a televiewer has the inconvenience [ one by one / the 
character of the document displayed on the window of the text / by the eye ] later on that a 
corresponding section must be confirmed. 

http://www4.ipdl.inpit.gojp/cgi-ta 10/8/2008 



JP,2001-209361,A [DETAILED DESCRIPTION] 



Page 2 of 1 1 



[0005]Making it indicate equivalent to which position of a still picture this position is by an 
operator specifying the position on the animation displayed by multimedia contents with the 
pointing device of a mouse is indicated to JP,9-152952,A or JP, 10-261 106,A. 
[0006] However, since this method does not display the position on a still picture 
synchronizing with the reproduced video, when displaying the position on the document to 
which the lecturer in an animation points on a still picture or a text, it cannot apply it. 
[0007]This invention solves such a conventional problem and an object of this invention is 
to provide the multimedia display which can display the correspondence position on a still 
picture or a document synchronizing with the contents of the reproduced animation or the 
sound. 
[0008] 

[Means for Solving the Problem]Then, in a multimedia display which synchronizes and 
displays an animation, or a sound and a still picture in this invention, A regenerating section 
which reproduces an animation or a sound, and a still picture indicator which displays a still 
picture, A graphic-display part which displays a tab-control-specification figure in which a 
position on a still picture is shown, and a playback position primary detecting element which 
detects a playback position of an animation or a sound by a frame number or time 
information, A position information storage which stores position information showing the 
display section of a tab-control-specification figure shown by a display position, said frame 
number, or time information on a still picture of a tab-control-specification figure, When a 
playback position of an animation for which a playback position primary detecting element 
was asked, or a sound hits at the display section of position information, a control section 
which controls a graphic-display part to display a tab-control-specification figure on a 
display position on a still picture which position information expresses is provided. 
[0009]ln a multimedia display which synchronizes and displays an animation and a 
document, A regenerating section which reproduces an animation, and a text display area 
which displays each page of document data which comprises two or more pages, What 
matched a reproducing section of an animation and a page of document data is made into 
a scene, A scenario storage parts store which stores a scenario which specified an order of 
two or more scenes, A graphic-display part which displays a tab-control-specification figure 
in which a position on a page is shown, and a playback position primary detecting element 
which detects a playback position of an animation by a frame number or time information, A 
position information storage which stores position information showing the display section 
of a tab-control-specification figure shown by a display position, said frame number, or time 
information on a page of a tab-control-specification figure, When a scenario is read from a 
scenario storage parts store, and a page specified to a text display area in a scenario is 
displayed according to a playback position of an animation for which a playback position 
primary detecting element was asked and a playback position hits at the display section of 
position information, A control section which controls a graphic-display part to display a tab- 
control-specification figure on a display position on a page which position information 
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expresses is provided. 

[0010]ln a multimedia display which synchronizes and displays an animation and a 
document, A regenerating section which reproduces an animation, and a text display area 
which displays each page of document data which comprises two or more pages, A 
graphic-display part which displays a tab-control-specification figure in which a position on 
a page is shown, and a playback position primary detecting element which detects a 
playback position of an animation by a frame number or time information, What matched a 
reproducing section of an animation and a page of document data is made into a scene, A 
scenario storage parts store which specifies an order of two or more scenes and stores a 
scenario which added position information showing the display section of a tab-control- 
specification figure shown by a display position, said frame number, or time information of a 
tab-control-specification figure on a page about each scene, When a scenario is read from 
a scenario storage parts store, and a page specified to a text display area in a scenario is 
displayed according to a playback position of an animation for which a playback position 
primary detecting element was asked and a playback position hits at the display section of 
position information on a scenario, A control section which controls a graphic-display part to 
display a tab-control-specification figure on a display position on a page which position 
information expresses is provided. 

[001 1]Therefore, when making it synchronize with an animation or a sound and reproducing 
a document and a still picture, a specific position on a document and a still picture which 
relate to the animation and sound closely can be synchronized with reproduction of an 
animation or a sound, and it can point to it. 
[0012] 

[Embodiment of the lnvention](A 1st embodiment) In the multimedia display of a 1st 
embodiment, synchronizing with the viewing area 223 of a text, the enlarged display of the 
document of the same contents as the document 222 which the picture of the lecturer 
indicating the document 222 was expressed as the animation 221, and was displayed on 
the animation 221 is carried out so that it may illustrate to drawing 2 (2). Cursor (a) is 
displayed on the position on the document 223 which corresponds to a part (a) if the 
lecturer in an animation points to the part (a) on the document 222, and if a lecturer stops 
this operation, cursor (a) will disappear. Cursor (b) is displayed on the position on the 
document 223 which corresponds to a part (b) if the lecturer in an animation points to the 
part (b) on the document 222, and if a lecturer stops this operation, cursor (b) will 
disappear. 

[0013]The digital video data 201 of the multimedia contents which display this animation as 
shown in drawing 2 (1), It is possible to read the playback position by the time or the frame 
from a reproduction start, and the multimedia display can control the display of a still picture 
or a document based on the read playback position. 

[0014]The animation 202 in which a lecturer points to the part (a) from time ta1 before ta2 
and on the document 222 is recorded on this digital video data 201, and the animation 203 
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indicating the part (b) from time tb1 before tb2 and on the document 222 is recorded on it. 
[0015]Corresponding to this digital video data 201, the cursor position information 204 
which described the classification of cursor, the display position of cursor, and the display 
section of cursor is recorded on multimedia contents. In this example, the cursor (a) 205 
From regeneration time ta1 to ta2 of an animation. Displaying on the position of (ax, ay) on 
a screen, and displaying the cursor (b) 206 on the position of (bx, by) from regeneration 
time tb1 before tb2 of an animation and on a screen is recorded as cursor position 
information. 

[0016] Drawing 1 (1) shows the multimedia display of a 1st embodiment. This device is 
provided with the following. 

The cursor position information storing part 101 which stores cursor position information. 

The cursor display part 102 which displays cursor. 

The still picture indicator 103 which displays a still picture. 

The moving-image-reproduction part 104 which reproduces a digital animation, the 
regeneration time primary detecting element 105 which detects the regeneration time of the 
moving-image-reproduction part 104, and the control section 106 which controls operation 
of each part. 

[0017]This control section 106 makes the moving-image-reproduction part 104 reproduce 
an animation, and displays a still picture on the still picture indicator 103, Based on the 
regeneration time which reads cursor position information and is obtained from the 
regeneration time primary detecting element 105 from the cursor position information 
storing part 101, It crosses to the screen position and reproducing section which are 
specified using cursor position information, and the cursor display part 102 is controlled to 
display cursor on the still picture which the still picture indicator 103 displays. 
[0018] Drawing 1 (2) shows the display screen which this multimedia display displays, The 
field of the still picture in which 121 is displayed on an animation screen and 122 is 
displayed on the animation screen 121, the directions position as which 123 is displayed on 
the still picture field 122 at the time of moving image reproduction, the still picture screen 
where 124 expanded the field 122, and 125 are the cursor position displayed on the still 
picture screen 124. 

[0019]When the directions position 123 is a position of (a) of the field 122 ( drawing 2 (2)), 
the cursor position 125 is displayed on the position (ax, ay) on the still picture screen 124 
based on the cursor position information 205 ( drawing 2 (1)) on cursor (a). 
[0020]At this time, the directions position 123 is one of the positions of (Xa, Ya) of the field 
122, and if the magnification to the field 122 of the still picture screen 124 is n, In displaying 
the directions position 123 on the still picture screen 124 for magnification as it is, the 
cursor position 125 corresponding to the directions position 123 serves as (Xaxn, Yaxn). 
Therefore, cursor position information is made to memorize as a position (Xaxn, Yaxn), and 
cursor is displayed on the position (Xaxn, Yaxn) of the still picture screen 124 based on this 
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cursor position information. 

[0021]Thus, in this multimedia display, while carrying out the enlarged display of the still 
picture embedded at the digital video data, cursor can be displayed synchronizing with the 
position on the still picture by which the enlarged display was carried out corresponding to 
the position specified on this embedded still picture. 

[0022]The digital video data compressed with the MPEG system as a digital video data in 
this multimedia display, The digital sound data etc. which were compressed by MP3 or a 
CODEC method besides the digital video data based on file formats, such as AVI and ASF, 
can be treated. 

[0023]Document data can be displayed on a still picture screen, and document data can 
also be treated. Image data, a document file of PDF form, a file of word processor form, etc. 
which image-ized the document besides the structured document described by a text file, or 
XML or SGML may be sufficient as the document data treated at this time. 
[0024]As cursor indicating a still picture top, the pixel image of an icon besides cursor or a 
small region may be sufficient. 

[0025]By adding the information displayed on an animation as cursor position information, 
the display of cursor may be synchronized with reproduction of an animation, and the 
display of a still picture, and may be displayed on the position not only a still picture top but 
on an animation. At this time, either an animation or a still picture may be specified as a 
viewing area of cursor, or both an animation and a still picture may be specified as the 
viewing area of cursor, and cursor may be simultaneously displayed on both an animation 
and a still picture. 

[0026](A 2nd embodiment) the position as which the new page of the document was 
displayed on the still picture field one by one synchronizing with the animation so that the 
page of a document might be wound, and the page was specified in the multimedia display 
of a 2nd embodiment — the specified period and cursor are displayed. 
[0027] Drawing 3 (2) shows typically the multimedia contents which perform such a display. 
[0028]The scenario 350 which specifies two or more scenes is set up by making into a 
scene what matched the reproducing section of a digital video data, and the page of 
document data, and a relation with the page of the document displayed during the 
regeneration phase of each scene and during that regeneration phase in this scenario 350 
is specified. According to this scenario, it corresponds to the scene 31 1 from the 
regeneration time t1 to just before t2 (t2-1), The page n of a text (331) is displayed on a still 
picture field, and it corresponds to the scene 312 from the regeneration time t2 to just 
before t3 (t3-1), The page n+1 (332) of a text is displayed, and the page n+2 (333) of a text 
is displayed corresponding to the scene 313 from the regeneration time t3 to just before t4 
(t4-1). 

[0029]The cursor displayed on the page of this text is prescribed by the cursor position 
information 340. According to this cursor position information 340, in the periods (321) from 
regeneration time ta1 to ta2 of the scene 31 1. It is displayed on the position of (ax, ay) on 
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the page n of a text (331) by cursor (a), and in the periods (322) from regeneration time tb1 
to tb2. Cursor (b) is displayed on the position of (bx, by) on the page n+1 (332) of a text, 
and cursor (c) is displayed on the position of (cx, cy) on the page n+2 (333) of a text in the 
periods (323) from regeneration time tc1 to tc2. 

[0030]When an animation is divided into two or more scenes and it reproduces by 
displaying in this way, it becomes possible to point to the correspondence part of a 
document according to the contents of each scene. 

[0031 ]The multimedia display of a 2nd embodiment that performs such a display, The text 
display area 303 which displays a text as shown in drawing 3 (1), It has the scenario 
storage 301 which memorizes a scenario, in addition the cursor position information storing 
part 101, the cursor display part 302, the moving-image-reproduction part 304, the 
regeneration time primary detecting element 305, and the control section 306 are provided 
like a 1st embodiment ( drawing 1 ). 

[0032]Reproduction of the animation of the reproducing section which the control section 
306 reads the scene of a scenario from the scenario storage 301 , and corresponds to the 
moving-image-reproduction part 304 and the text display area 303, The page of applicable 
document data is displayed, cursor position information is read from the cursor position 
information storing part 101, and cursor is displayed on the page of the document displayed 
by the cursor display part 302 based on the regeneration time obtained from the 
regeneration time primary detecting element 305. 

[0033]After reproduction of a scene is completed at finish time, the following scene is read 
from the scenario storage 301, the following scene is reproduced, and cursor is similarly 
displayed using cursor position information. 

[0034]Thus, it is possible to read in order two or more scenes contained in a scenario in this 
multimedia display, to reproduce each scene, and to display cursor by the position 
information on the cursor corresponding to the reproducing section of each scene. 
[0035]The digital video data compressed with the MPEG system as a digital video data in 
this multimedia display, The digital sound data etc. which were compressed by MP3 or a 
CODEC method besides the digital video data based on file formats, such as AVI and ASF, 
can be treated. 

[0036]Document data can be displayed on a still picture screen, and document data can 
also be treated. Image data, a document file of PDF form, a file of word processor form, etc. 
which image-ized the document besides the structured document described by a text file, or 
XML or SGML may be sufficient as the document data treated at this time. 
[0037]As cursor indicating a still picture top, the pixel image of an icon besides cursor or a 
small region may be sufficient. 

[0038]By adding the information displayed on an animation as cursor position information, 
the display of cursor may be synchronized with reproduction of an animation, and the 
display of a still picture, and may be displayed on the position not only a still picture top but 
on an animation. At this time, either an animation or a still picture may be specified as a 
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viewing area of cursor, or both an animation and a still picture may be specified as the 
viewing area of cursor, and cursor may be simultaneously displayed on both an animation 
and a still picture. 

[0039](A 3rd embodiment) In the multimedia display of a 3rd embodiment, cursor position 
information is included in the scene of the scenario. 

[0040] Drawing 4 (2) shows the scenario which specifies a multimedia display, and cursor 
position information (a position and the display section) other than the reproduction 
information of the scene which consists of a group with the page which displays the 
reproducing section which reproduces an animation, and a document is set up about each 
of the scenes 411,412, and 413. 

[0041]According to this scenario, while reproducing the scene 41 1 , Cursor (a) is displayed 
for the regeneration time of the cursor position information included in the scene 41 1 to an 
animation on the position (ax, ay) of the page n of a document in [ ta ] 2 seconds from ta 1 
second, While reproducing the scene 412, from the cursor position information included in 
the scene 412. From tb 1 second, cursor (b) is displayed on the position (bx, by) of the 
page n+1 of a document by the regeneration time of an animation in [ tb ] 2 seconds, and 
while reproducing the scene 413, Cursor (c) makes it display [ regeneration time / of the 
cursor position information included in the scene 413 to an animation ] on the position (cx, 
cy) of the page n+2 of a document in [ tc ] 2 seconds from tc 1 second. 
[0042]Thus, it becomes possible by embedding cursor position information at the 
reproduction information of a scene to process control of a scene, and control of cursor 
collectively. By this method, in order that the reproduction information of a scene and the 
position information on cursor may cooperate, synchronous processing becomes easy. 
r00431 Drawing 4 (1) shows the multimedia display of a 3rd embodiment. This device differs 
in the point without a cursor position information storing part, and the point that cursor 
position information is included in the scenario stored in the scenario storage 406, 
compared with a 2nd embodiment ( drawing 3 (1)). 

[0044]The control section 405 reads the scene of the scenario stored in the scenario 
storage 406, On a basis, the regeneration time which the regeneration time primary 
detecting element 404 detects from the reproduction information of a scene. Cursor is 
displayed by the cursor display part 401 during the display section of cursor on the page of 
the document which the text display area 402 displays from the cursor position information 
which makes display the applicable reproducing section of an animation and page of 
document data, and is included in a scene. After reproduction of a scene is completed at 
finish time, the following scene is read from the scenario storage 406, the following scene is 
reproduced, and cursor is similarly displayed using cursor position information. 
[0045]When one or more cursor position information may be included in each scene and 
two or more cursor position information is included, two or more cursor information included 
in a scene is read in order, and cursor is displayed. 

[0046]Thus, while reading in order two or more scenes contained in a scenario in this 
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device and reproducing each scene, it is possible to display cursor by the position 
information on the cursor corresponding to the reproducing section of each scene. 
[0047]The digital video data compressed with the MPEG system as a digital video data in 
this multimedia display, The digital sound data etc. which were compressed by MP3 or a 
CODEC method besides the digital video data based on file formats, such as AVI and ASF, 
can be treated. 

[0048]Document data can be displayed on a still picture screen, and document data can 
also be treated. Image data, a document file of PDF form, a file of word processor form, etc. 
which image-ized the document besides the structured document described by a text file, or 
XML or SGML may be sufficient as the document data treated at this time. 
[0049]As cursor indicating a still picture top, the pixel image of an icon besides cursor or a 
small region may be sufficient. 

[0050]By adding the information displayed on an animation as cursor position information, 
the display of cursor may be synchronized with reproduction of an animation, and the 
display of a still picture, and may be displayed on the position not only a still picture top but 
on an animation. At this time, either an animation or a still picture may be specified as a 
viewing area of cursor, or both an animation and a still picture may be specified as the 
viewing area of cursor, and cursor may be simultaneously displayed on both an animation 
and a still picture. 

[0051 ](A 4th embodiment) The multimedia display of a 4th embodiment is provided with the 
function to set up cursor position information. 
[0052]This device is provided with the following. 

The starting point set part 508 which sets up the display position of cursor, and the display 
start time of cursor as shown in drawing 5 (1). 

The terminal point set part 509 which sets up the finish time of a cursor display. 

The regeneration time amendment part 510 which amends the regeneration time of an 

animation forward and backward by the frame or a time basis. 

The cursor position information set up by this starting point set part 508 and the terminal 
point set part 509 is stored in the cursor position information storing part 501. Other 
composition does not have a 2nd embodiment ( drawing 3 ) and a change. 
[0053]ln this device, when setting up cursor position information, first, a text is displayed on 
a still picture field and cursor is displayed by the cursor display part 502 on this text. 
Subsequently, after stopping reproduction of an animation at the display start time of cursor 
and displaying cursor on the prescribed position on a text, the starting point set part 508 is 
operated and the display position of cursor and the start time of a cursor display are set up. 
[0054]At this time, the playback position of the animation stopped in the regeneration time 
amendment part 510 if needed is amended per 1 second or frame in advance of setting out 
by the starting point set part 508. 

[0055]The display position of cursor and the start time of a cursor display which the starting 
point set part 508 set up are held by the control section 506, and reproduction of an 
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animation is resumed simultaneously with this setting out. 

[0056]Next, after operating the terminal point set part 509 at the finish time of a cursor 
display, suspending reproduction of an animation and amending the stop position of moving 
image reproduction per 1 second or frame in the regeneration time amendment part 510 if 
needed, the finish time of a cursor display is set up by the terminal point set part 509. In 
response to this setting out, the control section 506 stores the display position of cursor, the 
start time of a cursor display, and finish time in the cursor position information storing part 
501. 

[0057]lf there is no setting out of the following cursor position information, edit will be 
ended, and the above operation is repeated when there is setting out of the following cursor 
position information. 

[0058] Drawing 5 (2) shows the setup steps of this cursor position information. 
[0059]Step 1: Stop an animation in the start time of a cursor display. 
[0060]Step 2: Set up the cursor position, set up the start time of a cursor display, and start 
moving image reproduction. 

[0061 ]ln order to set up step 3:, next the end of a display of cursor, after suspending 
moving image reproduction and amending step 4:finish time, display finish time is set up. 
[0062]Step 5: When the following cursor position information needs to be set up, repeat the 
procedure after Step 1, and when setting out of cursor position information is unnecessary, 
end. 

[0063]thus, it is possible to create the information for displaying cursor on the position 
which makes it synchronize with reproduction of an animation and corresponds to the 
contents of the animation on a still picture in this multimedia display. 

[0064]Cursor is possible not only for a still picture top but making it display on an animation, 
and sets up the information which shows making cursor position information display cursor 
on an animation in this case. About the display position of cursor, or setting out of display 
start time and display finish time, it can carry out like the procedure mentioned above. 
[0065]The digital video data compressed with the MPEG system as a digital video data in 
this multimedia display, The digital sound data etc. which were compressed by MP3 or a 
CODEC method besides the digital video data based on file formats, such as AVI and ASF, 
can be treated. 

[0066]Document data can be displayed on a still picture screen, and document data can 
also be treated. Image data, a document file of PDF form, a file of word processor form, etc. 
which image-ized the document besides the structured document described by a text file, or 
XML or SGML may be sufficient as the document data treated at this time. 
[0067]As cursor indicating a still picture top, the pixel image of an icon besides cursor or a 
small region may be sufficient. 

[0068]By adding the information displayed on an animation as cursor position information, 
the display of cursor may be synchronized with reproduction of an animation, and the 
display of a still picture, and may be displayed on the position not only a still picture top but 
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on an animation. At this time, either an animation or a still picture may be specified as a 
viewing area of cursor, or both an animation and a still picture may be specified as the 
viewing area of cursor, and cursor may be simultaneously displayed on both an animation 
and a still picture. 

[0069](A 5th embodiment) A 5th embodiment explains the describing method of the 
scenario in the case of including cursor position information in a scenario. 
[0070] Drawing 6 shows the scenario with which the tag which controls the cursor display in 
the cursor display part 502 was described. 

[0071]lt is the scenario which 601 described in drawing 6 using the tag <scenario>, The 
<video> tag in which a name defines the digital video data of st1 602, The <text> tag in 
which a name defines the document data of txtl 603, The <scene> tag in which it is shown 
that 604, 608, and 609 are scenes which reproduce an animation and a text 
simultaneously, 605 the reproducing section of digital video data st1 reproduced on the 
scene of the tag 604, The <video> tag in which a start attribute shows start time and finish 
time is shown with an end attribute, The <text> tag in which the page on which document 
data txtl displayed on the scene of the tag 604 displays 606 is shown with a page attribute, 
and 607 are the <cursor> tags in which the position information on the cursor displayed on 
the page of document data or the screen of an animation on the scene of the tag 604 is 
shown. 

[0072]At this time, the time to display with the tag 607 must be in the regeneration time 
which a start attribute shows display start time, it shows display finish time with an end 
attribute, and is described with the tag 605. that is, <(start of tag 605) = (start of the tag 
607) and (end of the tag 607) = - < (end of the tag 605) -- it is . If it is > (start of the tag 
605) (start of the tag 607) (start of the tag 607), it treats as = (start of the tag 605). If it is > 
(end of the tag 607) (end of the tag 605), it treats as = (end of the tag 607) (end of the tag 
605). 

[0073]The <video> tag which shows reproduction of a digital video data in the element of 
the <scene> tag which describes a scene like the tags 604, 608, and 609, It is possible to 
describe a scenario according to layered structure by describing the <text> tag in which the 
page of document data is shown, and the <cursor> tag in which the position information on 
cursor is shown, A scenario can be easily edited by the document description of such 
layered structure with a standard text editor etc. 

[0074]By adding the name attribute which shows the field on which cursor is displayed to 
the <cursor> tag in which the position information on cursor is shown for the tag 607 like 
the tag 610, It becomes possible to make the field on which cursor is displayed specify and 
to display the display position not only a still picture top but on an animation. 
[0075]As a 1st embodiment described, the multimedia display of this invention, The digital 
sound data etc. which were compressed as a digital video data by MP3 or a CODEC 
method besides the digital video data based on file formats, such as a digital video data 
compressed with the MPEG system, AVI, and ASF, can be treated. 
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[0076]Document data can treat the image data which image-ized the document besides the 
structured document described by a text file, or XML or SGML, the document file of PDF 
form, the file of word processor form, etc. 

[0077]The cursor indicating a still picture and animation top may be a pixel image of an icon 

or a small region besides cursor. 

[0078] 

[Effect of the lnvention]So that clearly from the above explanation the multimedia display of 
this invention, When making it synchronize with a digital animation or a digital sound and 
reproducing a document and a still picture based on multimedia contents, the specific 
position on the document and still picture which relate to the animation and sound closely 
can be synchronized with reproduction of a digital animation or a digital sound, and it can 
point to it. 

[0079]Such a display is a digital animation about a lecturer's behavior by the multimedia 
contents which get their raw material from a lecture, a lecture, research presentation, etc., 
When carrying out synchronous reproduction of the document quoted in the lecture with a 
still picture, it can use, when pointing to the contents of the animation on a still picture, and 
the contents, such as a lecture, a lecture, research presentation, can be shown intelligibly 
for a televiewer. 
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* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

LThis document has been translated by computer. So the translation may not reflect the 
original precisely. 

2.**** shows the word which can not be translated. 
3.ln the drawings, any words are not translated. 



DESCRIPTION OF DRAWINGS 

[Brief Description of the Drawings] 

[Drawing 1] The block diagram (1) showing the composition of the multimedia display in a 
1st embodiment of this invention, and its display example (2), 

[Drawing 2] The key map showing correspondence with the display (2) of the cursor on a 
screen with the multimedia contents (1) in a 1st embodiment, 

[Drawing 3] The block diagram (1) showing the composition of the multimedia display in a 
2nd embodiment of this invention, and the key map (2) showing multimedia contents, 
[Drawing 4] The block diagram (1) showing the composition of the multimedia display in a 
3rd embodiment of this invention, and the figure (2) showing the scenario of multimedia 
contents, 

[Drawing 5] The block diagram (1) showing the composition of the multimedia display in a 
4th embodiment of this invention, and the figure (2) showing the creation procedure of 
cursor position information, 

[Drawing 6] It is a figure showing the scenario of the multimedia contents in a 5th 
embodiment of this invention. 
[Description of Notations] 

101, a 501 cursor-position information storing part 

1 02, 302, 401 , 502 cursor display parts 
103 Still picture indicator 

104, 304, 403, and 504 Moving-image-reproduction part 

105, 305, 404, and 505 Regeneration time primary detecting element 

106, 306, 405, and 506 Control section 

121 Animation screen 

122 The still picture of an animation screen 

123 Directions position 

124 Still picture screen 

125 Cursor 
201 Video data 
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204 Cursor position information 

221 Animation 

222 Document 

223 Text display field 

301, 406, and 507 Scenario storage 

303, 402, 503 text display areas 

311, 312, and 313 Scene 

321, 322, the 323 cursor display sections 

331, 332, and 333 Page of a text 

508 Starting point set part 

509 Terminal point set part 

510 Regeneration time amendment part 

601 Scenario 

602 The tag which defines a video data 

603 The tag which defines document data 

604, 608, and 609 Tag in which a scene is shown 

605 The tag in which the reproducing section of a video data is shown 

606 The tag in which the page of document data is shown 

607 The tag in which the cursor position information on document data is shown 
610 The tag in which the cursor position information on an animation is shown 



[Translation done.] 



http://www4.ipdLinpit.go jp/cgi-bin/tran_web_cgi_ejje?atw_u=http%3A%2F%2Fwww... 10/8/2008 



JP,2001 -209361, A [DRAWINGS] 



Page 1 of 6 



* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the 
original precisely. 

2. **** shows the word which can not be translated. 
3.ln the drawings, any words are not translated. 



DRAWINGS 



[Drawing 1] 
( 1 ) 



1 0 3 
it Si S m 



1 0 4 



10 2 



* — v a? m. 



I 



10 6 













10 5 











1 0 1 



tit*B*&&*iSI5 




http://vsrww4.ipdl.inpit.go.jp/cgi-bin/tran_web_cgi_ejje?atw_u=http%3A%2F%2Fww.„ 10/8/2008 



JP,2001-209361,A [DRAWINGS] 



Page 2 of 6 



[Drawing 2] 
(l) 



2 0 1 



tal 



2.0 2 
ta2 



i 



2 0 3 
tbl / tb2 



(a) 



(b) 



2 0 4 
2 0 5 
2 0 6 





t-vn 




Steers 




(a) 


ax, ay 


tal, ta2 




(b) 


bx, by 


tbl, tb2 




http://ww4.ipdlinpit.goop/cgi-bin/tran_web_cgi_ejje?atw_u=http%3A%2F%2Fwww... 10/8/2008 



JP,2001-209361,A [DRAWINGS] 



Page 3 of 6 



(l) 



3 0 3 



*r * X h 



3 0 4 



3 0 2 



ii - v )V ; 



3 0 6 



«!»» 



3 0 5 



fctJS& 



1 0 1 



3 0 1 



IS? 



(2) 



3 1 1 



tl tal ta2 tbl 



3 1 2 



tb2 t£ icT 



3 13 




S/ = n 



3 2 3 



3 3 1 
3 3 2 
3 3 3 







***i_hi 


(a) 


ax, ay 


tal, ta2 


(b) 


bx, by 


tbl, tb2 


CO 


cx, cy 


tel. tc2 



7 



3 1 1 

3 1 2 
3 1 3 







tl. 12- 1 


n 


12, t3 - 1 


n + 1 


t3. t4 - 1 


n + 2 



340 



350 



[Drawing 4] 



http://ww4.ipdlJnpit.gojp/cgi-bin/tran_web_cgi_ei 10/8/2008 



JP,2001 -209361, A [DRAWINGS] 
(1) 

4 0 2 



4 0 1 



t * x h m. 



4 0 3 



I 



4 0 5 



4 0 4 



n & m m & 



4 0 6 



Page 4 of 6 



(2) 




4 13 













tl. t21 


n 


(a) 


ax, ay t 


al, ta2 


t2. t3-l 


n+ 1 


(b) 


bx, by t 


bl, tb2 


t3, t4-l 


n + 2 


(c) 


cx, cy t 


:1, tc2 



[Drawing 5] 



http://www4.ipdl.inpit.go jp/cgi-bin/tran_web^ 10/8/2008 



JP,2001 -209361, A [DRAWINGS] 



Page 5 of 6 



(1) 



502 



5 0 3 



n. 



5 0 4 



5 0 1 



3 



5 0 6 



r~ i 505 t T 13 



5 0 7 



5 0 8 



5 0 9 



5 10 



(2) 



i 




No 



[Drawing 6] 



http://www4.ipdLinpit.go jp/cgi-bin/tran_web_cgi_ejje?atw_u=http%3A%2F%2Fwww... 10/8/2008 



JP,2001-209361,A [DRAWINGS] 



Page 6 of 6 



6 0 1 



z 




60 2 



<$cenario> 



603 



6 0 4 



<text name^txtr href^** h*? 7 4 A,&" f> 



60 5 
.606 



<text name^txtl" pa*e=T t> 



6 0 7 



<curaoT left^ ICCT top^lWf starts" end^S" 



< video name^fttl" starts 11" end^iMF /> 

<text name^txtl* page^*!P /> 

<euraor left ="200* top^W 6tart= n 2(T end«^28T /> 



<video name- &tf start =^31" end^-iO" /> 
<text name^txtr pa^e^S" > 
^cursor teft^SOff top^SWf start="34* end=^ 38* /> 
<facene> 
<t/scenario> 



<cursor name="str left =^50" top^50r start="20" end=*2S" A> 



[Translation done.] 



http://www4.ipdLinpit.go jp/cgi-bin/tran_web_cgi_ejje?atw_u=http%3 A%2F°/ 0 2Fwww. . . 1 0/8/2008 





6 1 0 




09) B*B*m/T (jp) 02) §ft ij% & $g (a) oimnmm&m^ 

#^2001-209361 
(P2001 -209361 A) 
(43)&IS H ¥fi£l3*f 8^30 (2001. 8. 3) 



(5D intci.' m>mn f i f-vn-h*(##) 

G 0 9 G 5/00 5 1 0 G 0 9 G 5/00 5 1 0 B 2C028 

51 OH 5B069 
51 OQ 5C082 

530 530T5E501 
G 0 6 F 3/00 6 5 8 G 0 6 F 3/00 6 5 8 B 9A001 

m&m& »3fcJEtf>&8 OL (£ 14 H) g&HfcSK 



(21)fflS#^ 


4#S2000- 19014(P2000- 19014) 


(71)ffl®A 


000005821 










(22)ffliBB 


¥/&12<fp 1 ^27 H (2000. 1. 27) 




AEfl?n*TUA^FWl006#ift 






(72)f8?*& 
























(72)&l8# 










AKfltPWr1iA^Pmi006#fl6 ftTftgg 














(74)«SA 


100099254 








& W3«) 











(54) i&we>%m Tv^t'Tjy&mm 



(57) [gift] 

4ir. »jhBS:**-ra»Jhli**SB103i:. »JhH-h0> 
ffifiSr^i"* — y z-ufc^-f-S # — y /u*7j*gBl02 1 , 
»B<3¥5±flmfcfcffli-*?f£ffilll*ttitti05i:, 

SBl06i£^(t5 o »®i:IBl»$*T3:#-^»ahli*f5 ; 
±W#^fig$r, SbH<Of?^i:|5J»**TffiL*i-^i: 



10 2 



WJtBSm 

a 



* — v * a 



10 6 





« — 1 ( 105 




ma 







<2) 



12 2 



12 3 12 5 



1 2 1 





M2001-209361 (P2OO1-209361 A) 



1 

^■f-s -^f- * ? -< t *^a k. u ^ x „ 
apt, 

BtfllMBifcfitiMRwa^lZIW ic a fc 5 £ # . BMEffiBtt 

y *«r*Mft+5 4^- y 3rtE«taj t , 

^-^±©«fcB&^tfc«fgj£ig^fc**i-$ig^** 

set. 

[W*«3] fiW©S£K#oT*^£ftfc^-^-h 

iwna**{Si«2iT/**EW^ffinE(fira«« t uTHfjfEfi 
[«**4] mmb-xmbzmnv.xi&TF'tz,-?'^ 



2 

W)Wi<on£.&.WZy i^-A»4fc»±i$*iJflra»cJ:oT8* 

ft® co ¥f± E Ffl 1 - * tf)^- i? b £ ztfctt fc t> 
©£->-:/£ LT. flHR©->— V©M»*«r«J£U #v- 

jb©**eh t «rf*Jn Lfc y 

«(ria'>-*-y^-iB«»*»e>'>-^y^-*f**ii*, Suisse 

#Btftffl&*»fc#»fcttW©W£<fc«K:jei:-C. wTIBt- 
^^-fr, lo, HfjKS±{iB* 5 *trlE^y ^-w{i:B1*# 
ro*^fi:B KiiftlEtiBmigia^ 5 i 5 icSulSBl 

^Bo 

30 [»*«7] B(rEfi[«a«*s, Bffi5{iBfi^ia^©ti) 

B±£0*^{iBt*^EI^i:Sr*U, S&ieiH^^^ 
HulHfi[BJt^lll^S:Wilii±l-^i--5r b&&Wlb 

*^^B„ 

-Yt<— •^kLfcfv J !5'/K^- -^x— PDFf- 
&l.< ft? -70^-9 frbtiLZ^bZftmb-tZ 

[0 0 0 1 ] 

^Tt5^f^f^rii8irau wit, mm 
wftft&teb'cDmmz. ^^tyt^Tzmm 

[0 0 0 2] 

so [*£3fcCDgflf] T/l/f/f-fTS^Illi, -^JU^^f 



1#Bfl2O01-2O9361 (P2001-209361 A) 



3 

[0003] mm^mm, m^m^k-^mL-tz^^ 

[0 0 0 4] 

[0 0 0 5] ^^^^7 = vfvy^i DSc^n 

^$t?.rt f±. #§sw 9- 1 5 2 9 5 2 ^n^wm 

¥10-261 10 6^<k$8(£l5tt£;h/rv^.5„ 
[0 0 0 6] Lt4>U ^<D%m-i. WtkZfrtzWiWmz 

hilt, &±m±.<D{iLm&^i-z>t><DX'tem\'^ : ' 

[0 0 0 7] ^WMli. r o Lfc^3fe(75Fpm^5:fi?*i- 

vyPf^r-f7f^gI^fftt5rt?rSWf: LT^ 
[0 0 0 8] 

[s^H^ft?*-T5fcJt)(D^] |-;f, ^fPJT-fi. » 
T^aii-SH^g^ai^t. &E*t^lllJF^#U:lli± 



4 

[0 0 0 9] Kjpii:^:»i5rl^«L-C*^-r5-7 

^ C?Jb©fit«Sr^i-flr«}f3eigjgSr3f*i-5|g® 
-^±W**feg^*filE7 l — A»*fcl*B#^J«aT^ 

k # , {uBtf #is*i-^-^±©**fir*t(fe«»Sia 
Jg«r**1-3 £ 5 fca?l5**aiJ*iW«ii-5«!l»«B 4: SrK 

20 [o 0 l o] »Pii:5:»tSrl^»iUT^i-5^ 

5 v+ y ^-fEttas t . y *sa«aj*» e> y * 
[ooii] ^(Dtcfr, mm^ffkmm&itxxw*? 

[0012] 

U<0^/\yf-^y ! ^T^^m.X'\^ 0 2 (2) |C0iJ^-f 
5± S:«222?:tgL^-r5SWro®^^t!)®221T-* 
*$tL s lS®221IC*^$ttfc5:*222 4:|^U.F , g^ro3t» 
;4Sx^^. h<D^^ffii&223l;:P3ILTfc*;3?^£;Jx5 0 

»|iifi©»Sf*s*»222±©jB9f (a) ^JtL^ 
-ft, m\ (a) IClg^-r5.Jt#223±CD{igl^^-y 

so jv ( a ) *«**$ix, <Dmt*±it>z> kt> — y 



&B82001-209361 (P2001 -209361 A) 



5 

/U (a) jJS*it5. Sfc, »B*^«MW*:*:»222±© 
«9f (b) *»L«rt, ©Sf (b) ^»a + 53t»22 

3±offi«fc*— y/i^ (b) as**s*u 
fP*±»5i:*-y^ (b) 

[0 0 13] 0 2 (l) teS*-f-J: rcotd® 
[0 0 14] r<o^^/i4ftBx— *20iicf*. IfCT 

^ s B#glJtal^C ? ta2*"CC0W> 5l*222±(D@Bff (a) 
SrJa L^i"ll!iB202^fH® $ «Fj0|tbli» btb24 T*c7) 
IB. 3C»222±(Dffi/?r (b) *«L^i-»H203«S|E»$ 

[0 0 15] v/pf ^f'^T^yry^^lj:, r^xv^ 

— y^&fitf«204-^IS®$ix5o r^flJ-etts # — 
y^ (a) 205£r, SbBO?¥±B^Jtal;&*&ta2£-e<£> 
Wk ®ffi±cO (ax. ay) (PffiBfc*^ # — y/U 

(b) 206£r. tbpj<7)|f^S[|tbl^??tb2*-e^ra, H 
SJico (bx, by) co&S^^-r^r kfr%— y/H£g 

[ 0 0 1 6 ] m 1 ( 1 ) tt, JB 1 OiafiJBttiO-r/^7< 

7^ zs^bs:^lt^2>„ r^SSi, y/Htt 
Bfi?«*»»i-5*-y/uffi«W«»««ffi0li:, 
y^Sr^^i-5* — y/^*^lH5102i:, f§K±H£r^rrf 

*0*mS81O5t. *»^»f^Sr*0»'rs»J»SBlO6i:S:« 

[0 0 17] Z(DfflmMl06lt* »Bllf*aB104te»HfS: 
W£S-B\ »ihH**«B5i03tc:»JhHS:**S*, 
y/WfcBW SMMASBlOl J: 5 #— yyH4««««r«5*a 
W**ja»m»l05i»b#fetL5W*l**!lK:*<5t^ 
^-yyuffiKWfllfcioTJB^SnSMaffittXV 
H4KIBfc*9, »JtH**SBi03*s*^i-5»JtHf±' 
K* — y/wt«3^-*-5 i5K* — yyu««flBl02*r*«i 
t5 0 

[0 0 18] Ull (2) 11 :^f^7^7*/Tg 
B*s«*-t-***liiffiSr*LT*5 9, mttttBBS* l 
22ttftiillBffil2iK***n5»JhH^«JR, l23{iSft® 
H**fcl>JhB««122te***JxaJB*ffi«, 124l*ffi 
$ci22£ffi*: LfclfcihBBB, l25tt#JhBiBBl24K* 
y^ffiB"Cfc5 0 

[0 0 19] »»(tt«123as % ffi«122(D (a) cofig 
(12 (2) ) T-fc5i:#. * — y/UffiBl25tt, # — 

y/u (a) O*— yylHfcB««205 (0 2 (1) ) leg 

O'^T, »JtWHffil24±^(fi:B (ax, ay) 



(4) 

[0020] rcDirt, Jt*t£fil23^®«i22(D (Xa, 
Ya) OfiBt-fct). Sfc, »Jh«Wffil24^>1H*l22C» 

-e»jtBiBffii24^«*^aii^^tt. »sM&Bi23f;i*t 

— y^ffifil25tt (XaXn, YaXn) i&5 0 {£ 
oT, >(7 — y/H&B«#KffiB (XaXn, YaXn) tU 

B*S*. ro*-yyuffifiW*lc«<5v^-c, #— y/u 

S:#iL®Sf®124(7>ffiB (XaXn, YaXn) |e^£it 

[0021] roOct 5 r (D^/^^'f-c rm^^w 

5 iritis r oa»ii*ixfc»il:B±-e«S* 

fc % *-y/vSrl^fflbT**r5ri:^-C#5o 

[0 0 2 2] KDv;l/f^fV7$^gIt*lj:, TV>^ 
^»If- 9 k Lt, MPEG**TJEfg£jh,fc^>>* 
;vftlf-?s AVI S AS FteX<D7T'( /Wl^ei: 
Sx^^^ibBx^-^tota^ MP3^fciicoDEC 

[0 0 2 3] ^fcs »j£BBffil-:£#x — *£r^*£ 
X — ^11, f=3r^ h77^^$fc(iXMLSfc|j:SGM 

D 7#5£<D 77^ J^ta if X t> ± V \ 

[0 0 2 4] Sfc, »±B±S:»L^i-* — y/^t LT 

30 Bte-efcii^o 

[0025] *-y/uttlll»*iLt, »B±fc 
^S-fr5«aSrf+J0i-5r <b(-J: 9. ^7 — y^co«^ 
«iB©lf*i:#JhB«>**i:teWIJtl**"C. #±B 

£\ »B**itt#il:Bo— *«ltS:* — y/^o**«tt 
irLTjg^bfct), »Hi:»JtB«)W*S:* — y/^O* 
*«Wfc»jeL.T, »BarW»JhB«>H*KWIi*fc* — 

[0 0 2 6] (12 <£>HJ£^ffiO jR 2 (DmH&Mm<D^rj\y 

«t 5te*»<o*bv^-^s|||iJfc#JfcB«l«fc 
^*^tL, *©-<-^0»*SixfcttBlw, *fc, 

[0027] 0 3 (2) r J: 5 ?i*^^ff 5*^/^ 

[0 0 2 8] f^^/i/BBT-^^StEWtitf- 
fKD^—i/k %ttfcHlffct><D$:i/—^k LT, 

^350T% #^-y^)Bmt, *<o?5*JIIIIBfc*» 
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Hftot, S^8#^Jtl^^t2COKmJ (t2-l) JWv/ 

n (331) flSS^Sft, S^0^Jt2^^t3(^agj (t3- 

1) jT^^y312CTKLt, h(£>-<— i?n 
+ 1 (332) Sfc, ft£J$Mt3i>*t>t4<DX 
M (t4-l) V313^^LT, X^htf) 

+ 2 (333) #*^$it5o 
[0 0 2 9] r^** ^±K*SSfl 

£ 0 wO* — yyHtt«**340KftoT, V311C7>S 
4«F*Jtaia»feta2*"C©»!n (321) f£f3\ x^r^^CO 
i/n (331) _h(£> (ax, ay) O^StC^ — y/U 
(a) W^^Jtbl^^tb2i-e<^^Ps1 (32 

2) ^fl, X^r^ htf)^— i/n + 1 (332) JLO (bx, b 
y) Offi«^*-y^ (b) 38S*»*tL, W£l$*JtclJ&> 
e>tc24TC0«M (323) y"** h<0-<— v?n + 2 

(333) _b<D (cx, cy) (7>{£Stc# — y /V (c) j&S^tf 

[0 0 3 0] ^coi fcfcij: 9, ibMSr^ 

[0031] r 5 Lfc^srtT <DmmMm(o^/u 
^tr^T^mwte. H3 (i) (CTF-ri^^, 

n^n (Hi) kw*K, *-yyHtt«««»»85ioK 

* — y/U«*«B302, K)MS£^304. «£B#2fltfcWSB30 
55: t^J»gR306 V* S . 

[0 0 3 2] fl§ij«^306te, U *-*MftaB301 «t 5 

y^C/— ^S:K*a* % »SfW^ffl304Xt/7 i *^ h 

*j^aj$C305/i^#bn6i?^*jt-s^v^T. y 

[0 0 3 3 ] 5x->oS^ASHT^S0f-l*7-t-5i:. ft 
^SrS^U P«K*-y/uS:*-y/uffl«W«^J: 0 
[0034] ^CD-vVU^-t^ T^^ISE 

[0 0 3 5] rco^vu^-r >r T^gitll, r^^ 

/HiJli-r — 9 . AV I „ ASF4 if 0> 7 7 <4 jvffiRXc i 
Sf^^/Hlllf- ^<D15£\ MP3SfcftCODEC 
*SCft if K J: 9 BE* $ Jxfc^* A^**?*-* ft if £fe 



[0 0 3 6] ifc, #JhlBlfffiK3t»T r -^S:*** 
X — ^f3U f*^ h77>f^$feliXMLJtliSGM 

/c^^-yf"^, PDFMWf77^/K 7" 
nff^(?57r>r^ftifT*fcctV\ 
[0 0 3 7 ] »JhSS±S:tSU*"t-*-y^i: bT 

[0 0 3 8] ifc, #-y/Htt«fff*i tt, »W±^ 
i#Jl:BfO*« 4: KIrIJBI**T, ttJtW 

y^Sr^^^TtctV^ 

[0 0 3 9] (S6 3 co^ajKJfi) US 3 CQH16JgffiC0-e^ 

20 f^fV/S^iltll *-yyvffi«W«4r^y^ 
[0 0 4 0] HI 4 (2) tt N ^^f^7^TS:IS 

-r5^y*Sr*UT*3 9, V411, 412. 413^^ 

-y/HftB** (ffi«fc**EM) *»3&SJx-CV^5. 
[0 0 4 1 ] r(7)iy^-y ^"[ct^oT, v/— >4115:?5^ 
<t»tt, V4ii^4ix5* — yyHStH««36»6>, lb 
M^S^^J^tal#^^ta2#OffilC^#^>^<-- v^nCO 
so {iS (ax, ay) {C% — y/U (a) J&S**$*L, i/— ^41 

2Sr?l^4 3 11, V4i2^4ix5 * - y /Hft«W«** 
»ffi^s^*J>&Ubi&^^tb2S?(7)pa^s:*^^— 

v^n+lWfit (bx, by) Jd* — y/U (b) ti^TF $ 

^7 - y /uffiai**^^ . »H 4*ftj36 s tci&36» ?5 tc2 

$P<Dffl\C$:Wr<D'<*-i/n+ 2<D^M (cx, cy) tC^7 — y 
yu (c) 36sa*S*5 0 

[0 0 4 2] iy-v^s^if^ic^— yyu 

40 /u<Dfflmt&— gttjaitSw ir^pjtgtd^So * 

■ft«R t * s a» S *t 6 ft |BUW«Hl3JS#» 4: ft S. 
[0 0 4 3] El 4 (l) ^3^)*J6teff^^^/^^ 

SI (H3 (1) ) tlt^T, *-yyHtt«««»tt$B 
Srfipfcft^^, Rt5. ^y*»»W406K*«S*L5 

e 0 

[0 0 4 4] *JffllSP405tt x V^- y ^-*&*fla5406tC*&^3$ 
so tb/cv-f-y >Srtt*ii*. S^S#*J^I±S$I5404 
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— y/Ko^^EP^cop^, y^^^gMoiKJ: 9 , y- 
*x h&^$$402fcm^-F%$;9<D-<— i?±ic. # — y 

D;o->-y*B4LT, y/u^r*— y/w 

[0045] 7iib\ i oui±co^— y/Hi 

[0 0 4 6] r<75i5l-, i©jg«-Cf4, 

J: 0*-y/wS:***-a:* it ^flB-pfc 
[0 0 4 7] rw-^/i^y -r -1- r^SIS-Cfi, xv>* 

^ftlf"^ , AVI, ASFit'077-/ )Vjfc£\Z. <fc 
Sx^^/l'KlPix — ^<OJi*\ MP 3ifcliCODEC 

*5t* J: *> mm £ ttfc-r-y * /^ff— ?tet°zm 
[0 0 4 8] &±mmm?-xwr~? 

X — ^f4, f + ^ h77-Y^tfcttXMLSfcltSGM 
fc^y—yx — PDFlSotf77^/K *7 — 7° 
[0 0 4 9] £7c, #itpj±SriiL^-t-^— y/Wt LT 

14, x — y/watiK r-r => y^Ttte/MMtWfc'^-tr/w 

[0 0 5 0] *-y^jftHt«iLT. »W_Lfc 

»®*fctt»jh®©— *«»tSr*-y/K03f*«« 
Tj^WSl-JfJfeLT, S!]®S.t/#±ii)Oia]*-|c|i]B#(c*- 

[0051] (* 4 <Dmmmm) m 4 ©njMg©-^ 
f^7^7«*iin *-yyWft««««ria:Si-5« 

[0 0 5 2] rc9$£ttf4, 115 (1) iCTji-t i 9 IC, ;*> 
5*6^K^SP508i:, # — y^**tf>f&TB#£ l J : H9:5t-f- 

s#pfl ^fit-cwa kmie-t 5S^H#gij«jEgi55io t *m x. 



(6) 

titc#— y /M&Sli #U4, *— y /i^t«W«t&tt«B5oi 
i^&mztiZo *<Dfc<K>m&utm2<omi&j&te (in 3) 

[0053] znmWT-rt. #-y/Miz:«W$8£i2/£-r 

10 — y/u^cDM*&^JSr^^i-5„ 

[0054] iOtf> ^.^^a5508T-W^SlC^Sz: 
W£B#£iJMlEgB510T\ &m\^foCX. ffJhS*3t 
1 tfrSfctt 1 7 u-A^fix-ttlEi- 

[0 0 5 5] te^^5508aS5£^Lfc# — y^©^F 
ttfltRV* - y ^**©Mtel$#Jf±«fiPtt506-C#«f $ 

[0 0 5 6] * — ysl^t7F<DlfcT&TM\Cfe&Wlj£ 

20 10T\ i^g^JSCT, IbWff^roffit^fiS: l#4fc{4 
l x u— i^Wi-CMiELfc^, ^,^^ai509|n J: o . 
# — y/i^jj*©l*TB3 i igfc8S:5£1-3. i^K^^gtt 
t, ©JWfB506tt, * - y {£t t * - y 

©0B*&l$*!J&imTI#*9 1 «r*-y/Htt«*«*ittaJ50 

[0 0 5 7] efcro^r-y/HttaitWwKJtiisSSftttfJIi 
ilitTL, »©#-yAH&«*«©»:J&& £ #Sfc£ 

[0 0 5 8] in 5 (2) 14. r »y? — y/Wigtf#cD^ 

[0059] 7fy/l : »®Sr* — y/U*^C0M^ 

[0 0 6 0] ^.7 i ->y , 2 : ^-y/i'tttSrSSLT, * 
-y/uaf^©M*&«f*JSrK3£L, «UBH*S:Hi*&i-5. 

[0 0 6 1 ] ^7y/3 : ftic, * — y /U«D*^i^TSr 
K3t-t-5fc»l;:»iiiiff ^SrfltJh L. 
^y i s/y , 4 : ^TB#*J£«IEL7-cm. **»T^F*JS:ta: 

[0 0 6 2] ^77/5 : ^co^-y/HiStf^^iS:^: 

U *^c, *-y/^Bffif#(0^)t^^S^v^-g-|4*l- 

[0 0 6 3] rcoieiic:, :©v/uf^7-f7Sfig 

ttS-f-5fl[«»!:*-y^4-**$-fr*fc«)©««4:^ 
■tZZbifi-sjmX'&Z. 

[0 0 6 4] *fc, *-y/K4, #ih®±fc»tT-/j: < , 

t>— y/Wi«tf®ic, y^S:i&®±ic*^$-ar?>r 
so t^^-rw^§r^^-r?>. a-y/naSiSMftB-^at^H! 
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[0065] ^(o^iuT^f^Tm^mm'vn, y**J9 

A4tm*r*- 9 t LT, MPEG*a:T*ffiffiSixfcT^^ 
yuftpfx"-^, AVI, ASF4if07r>fyHBS;»e:J: 
5^*>^ftMx — *<0ti*\ MP3if:(iCODEC 

[0 0 6 6] frJtBWffiKX*^— i'S:*^* 

[0 0 6 7] *7t, »JhW±S:«b*i"*-y^i: LT 

[0068] sfe, #-y/W£atif#t tt, mm±iz 

«\ »W©1^i:#Jl:W©*«i:KlRlJH**-C, fiMhW 
Jb*:»t-C4<»iif±©ffi|l^**S-a:T 1 bJ:v^o -<£>t 

[0 0 6 9] (15 oHltJgffi) ft 5 ^HJSJgffiT-tt, 
# - y ;W3l gff $S Sr y d-K* ft 5 4§^0 W 5 

[0 0 7 0] 0611 y/^^H5502XO# — y/u 

So 

[0 0 7 1] ID 6 tC:fc^T, 601 n 9 9< scenario > 4: 
ffl^TfaiSbfcv'-J-y *"C*>9, 602ttifeHU^s t 1(7) 
7* is 9 /unWr — 9 & fem-t 5 < video > 9 9. 603 
WAS t x t 1 <D3cWt — 9 Sr^tti"^ < text> ^ 60 
4. 608. 609!it!j®Ii:^3r* b £ ^3 v-— 

>Tfc5: fc Sr^i"< scene > 9 9, 605ft^ ^6040 is 
— >X-W$L$tiZ>7*i?9/i>Wim j r--9s t KDWZi&m 
Sr. BtartJRtt-ClBttWa*:, endJRttT^T^J ^^i" 

< v i d eo > 9 9 „ 606 ^ ^604 <£> V— V "C*^ $ Jx 5 X 
St 5 —* t x t 1 5 v^pageJgtt-Tr^r 

< text > * 9, 607te * ^604(7) V— yt'Jfr- * C0^< 

if ft £ ^"T < cur sor > * -/T *> S . 

[0 0 7 2] C<DP3\ ^^607T**^-f 5B#F5H start 
JRttT«^HI*ftW««:, end*H*-C****T«f*J«r» 

V\ o*9, (*^605<£>start) <= ( ^ ^607 <7) star 
t) a>o (^607<7)end) =< ^605Oend) "Cfc 
6o tU (^605?)start) > (9 9607 <D start) 4 
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b (^^6O70>start) = ^605CDstart) £ LTft 
5, (^^607cOend) > (^^605COend) ft 

(^607<£>end) = (9 960S(Dend) £LT&9 0 
[0 0 7 3] 9 9604, 608, 609<£> <fc 9 \Zis— V 

5 < scene > * i/cDg^f C7) 4* l-fv'^ /HSr 
— *<0ff£&^i-<video>**\ 9<D<<— is 

&7F-t<text>9 9, Rlttl — y^^ffiHff«S:*t< 
cursor >^^«rf5a?"r 5 r fctiO, is-TV *&Ptmfc 

* ft if m i d t a*-r 5 r fc a* # 5 o 

[0 0 7 4] Sfc, *^607£r, 9 9610(D£ 5f-# — y 
/K^ffifilf *Sr*i"<cursor>^^ r [C > # — y^S:*^ 

S*5flB«Sr*i-name«ttSr{d-*D't-ar. irtcJ: 
y^Sr**$*5««SrM***, *<fc**ffi«4r»Jh 
M_tfctf T*ft < mm±^ fc^J^^t a^ffiKft 

[0 0 7 5] ft*5, *3SW^^^x>f T^3$fi 

20 ^tLT, MPEGMT'iElg^ixtT^^^SiHf- 
AVI, ASF4^77^/*S^J:^7^ 
Wm"r — 9<D&i)\ MP 3*fcttCODEC*a;44f^ 

[0 0 7 6] Xfr'-^lis 7^h77^;^ 

30 [0077] i>jtmji^ibs±*«u*i-*-y 

/ufts ^7 — y/K7)l5^Mc. T-Y ^ l/ J t~>/hm$Z<Vt°9 J t/i<' 
[0 0 7 8] 

40 ^5"C#5 0 

[0 0 7 9] r 5 Lfc*^H W*3B«ft 

^(om^n^^fi>9^W}mx\ *>t, t^Kat-egira 

[BlS^ffi^fttftP^] 

[Ell] *5§^cof?l ©JtJfc»«Ki3»t x-Y 
so T*^*«^«^Sr*"t-^ny^ia (1) *(7)** 
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m (2) , 

1(112] mi OllilCiolt ^ fV 7 ^ yf 
>y (i) £, Ilito^- ysucom^ (2) £CQ2t 

fV/^yry^^^tfi^g] (2) , 

f^rnyfyy^^tyt^tin (2) , 

Tm^£U(omf&*^-ty* (1) ^7— y/u 
<tt««#^ffric#«S**i-B (2) , 

[El 6] **MO®5<0||je3g1B^*5JtS^^7<7 f -f 

101, 501 y^Ha««f*»iWaj 

102, 302, 401, 502 # — y/l^^i 
103 ffUtpI*^ 

104, 304, 403, 504 ftiUS^gtf 

105, 305, 404, 505 W*Et$MWitti%V> 

106, 306, 405, 506 $Jf$£G 

121 RjMBjS 

122 mwrnmnwitm 
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123 tg^a 

124 #lh(S®S 

125 # — y/u 

201 aif-^ 

204 # — y;M£B1#«i 

221 tfeH 

222 -xm 

223 -r-^rX hX^fltt 

301, 406, 507 \/~rV3-1fe®\U 

io 303, 402, 503 "T$r^ h^^£C 

311, 312, 313 

321, 322, 323 # — y/U^^EM 

331, 332, 333 h cD-<— v> 

508 

509 ,^£f£/H^ 

510 W^«F*JMjEffl 

601 is-t- V st 

602 »H-r-*S:J£«i-5*^ 

603 ^Sx-^Sr^-r^)^^ 

20 604, 608, 609 i/— V&^-f^;/ 

605 fbSfx — ^oW^EPplSr^i"^^ 

606 ^^7—9 <r>^~*J&7tt9 # 

607 i:*^— — y^ffi«««Sr*i-^^ 
610 »H±o*-y/uffiBfflf«S:^#^ 
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3 0 3 
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3 2 3 
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(12) 



[124] 



4 0 2 

r * x h m. 



4 0 3 



4 o 1 



^ 4 0 



4 0 4 



B £ B5 » ^ 



4 0 6 



(2) 




4 1 3 
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(13) 



[05] 



5 0 2 



5 0 3 



n 



504 



5 0 1 



1 



I 



5 0 6 



5 0 5 



fctJ28 



J~i so 



5 0 8 
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5 10 
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[161 



6 0 1 




•Csoenario> 

<video name^fitr href^KBS^ r 4 '^£> w f> 
6 0 4 <textnaine= e txtr href^T 1 * X * "7 r 

~<acene> 

<video name^atr starts 0" end: 
<text Dame^txtl 1 * page^ 1" /> 
<curaor left=* 100" top-" 100" starts 4 P end^S" /> 

6 0 8- </scene> 

• <scena> 

< video name^atl*' start^lT end^30" /> 
<t&xt name="txtr pa%e=?T t> 
<cursor left^200 n top^2«T fttart^20" end^'28T /> 

6 0 9— J <fecene> 

^ <Bcene> 

<video nam^fitr start="3r end="40" /> 
<text name^txtl" pa^e^aT l> 
^cursor tefc^SOCT top=*30<r start="34" end=^3r /> 
</scene> 
<7sc©nario> 



6 0 7 



6 1 0 




<cursor name^st!" tea^SO" top="50r starts 2(T end=*2B* t> 



(51) Int. CI. 7 BfcBUK* F I T-^-F* 

G 0 6 F 3/14 3 8 0 G 0 6 F 3/14 3 8 0 B 

G 0 9 B 19/00 G 0 9 B 19/00 Z 

F ^ — A 2C028 AA00 

5B069 CA17 DD16 GA08 

5C082 AA01 AA03 AA05 AA15 BA02 

BA12 BA27 BA29 BA34 BA41 

BB25 BB26 BB46 BD01 BD02 

CA04 CA52 CA54 CA76 CB05 

DA61 DA86 MM05 MM08 
5E501 AB13 AC14 AC16 BA03 FA02 

FA 15 FA32 
9A001 JJ19 JJ32 



